Conformal Predictions for Information Fusion A Comparative Study of P-Value Combination Methods
نویسندگان
چکیده
The increased availability of a wide range of sensing technologies over the last few decades has resulted in an equivalent increased need for reliable information fusion methods in machine learning applications. While existing theories such as the Dempster-Shafer theory and the possibility theory have been used for several years now, they do not provide guarantees of error calibration in information fusion settings. The Conformal Predictions (CP) framework is a new game-theoretic approach to reliable machine learning, which provides a methodology to obtain error calibration under classification and regression settings. In this work, we present a methodology to extend the Conformal Predictions framework to both classification and regression-based information fusion settings. This methodology is based on applying the CP framework to each data source as an independent hypothesis test, and subsequently using p-value combination methods as a test statistic for the combined hypothesis after fusion. The proposed methodology was studied in classification and regression settings within two real-world application contexts: person recognition using multiple modalities (classification), and head pose estimation using multiple image features (regression). Our experimental results showed that quantile methods of combining p-values (such as the Standard Normal Function and the Non-conformity Aggregation methods) provided the most statistically valid calibration results, and can be considered to extend the CP framework for information fusion settings.
منابع مشابه
A Comparative Study of 3-D Conformal Radiotherapy Treatment Plans with and Without Deep Inspiration Breath-Hold Technique for Left-Sided Breast Cancer
Introduction: The rate of cardiac diseases have increased among patients who underwent radiotherapy for left-sided breast cancer. The study’s aim was evaluate the dose to organs at risk in free-breathing 3-dimensional conformal (FB-3DCRT) against 3-dimensional conformal deep inspiration breath-hold (3DCRT-DIBH) in patients with left-sided breast cancer. Ma...
متن کاملApplication of computed tomography and magnetic resonance imaging fusion images for delineating gross tumor volume in three-dimensional conformal radiotherapy of nasopharyngeal carcinoma
Background: To evaluate computed tomography (CT) and magnetic resonance imaging (MRI) fusion images for delineating gross tumor volume (GTV) in three-dimensional conformal radiotherapy (3D-CRT) of nasophanrygeal carcinoma (NPC), and compare treatment outcomes between CT- and CT+MRI-based targets. Materials and Methods: A total of 120 NPC patients treated with 3D-CRT were included, in which, 60 ...
متن کاملCombination of Feature Selection and Learning Methods for IoT Data Fusion
In this paper, we propose five data fusion schemes for the Internet of Things (IoT) scenario,which are Relief and Perceptron (Re-P), Relief and Genetic Algorithm Particle Swarm Optimization (Re-GAPSO), Genetic Algorithm and Artificial Neural Network (GA-ANN), Rough and Perceptron (Ro-P)and Rough and GAPSO (Ro-GAPSO). All the schemes consist of four stages, including preprocessingthe data set ba...
متن کاملComparing Performance of Different Inductive and Transductive Conformal Predictors Relevant to Drug Discovery
We present an evaluation of the impact of transductive, inductive, aggregated and cross inductive mondrian conformal prediction on the validity and efficiency of predictions. The aim of the study is to give guidance to which methods perform best where there is limited data. The evaluation has been made on a large public dataset of Ames mutagenicity data, relevant for drug discovery, a spam data...
متن کاملComparative Evaluation of Image Fusion Methods for Hyperspectral and Panchromatic Data Fusion in Agricultural and Urban Areas
Nowadays remote sensing plays a key role in the field of earth science studies due to some of the advantages, including data collection at a very low cost and time on a very large scale. Meanwhile, using hyperspectral data is of great importance due to the high spectral resolution. Because of some limitations, such as hyperspectral imaging technology, it suffers from a reduction in the spatial ...
متن کامل